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Abstract 


There exists a number of mathematical procedures for designing 
discrete-time compensators. However, the digital implementation of 
these designs , with a microprocessor for example, has not received 
nearly as thorough an investigation. The finite-precision nature of 
the digital hardware makes it necessary to choose an algorithm 
(computational structure) that will perform 'well-enough' with re- 
gard to the initial objectives of the design. This paper describes 
a procedure for estimating the required fixed-point coefficient 
wordlength for any given computational structure for the implementation 
of a single-input single-output LQG design. The results are compared 
to the actual number of bits necessary to achieve a specified 
performance index. 




* This work was performed in part at the MIT Laboratory for Information 
and Lacision Systems with support provided by NASA Ames under grant 
NGL-2 2-009- 124 and part at the Charles Stark Draper Laboratory. 
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1. Introduction 

The design of discrete-time compensators through the use of 
optimal regulators , pole-placement concepts , observer theory , optimal 
filtering [1,2] and also via classical control theory [3] has received 
a great deal of attention in the literature. In the past such designs 
have usually been implemented on large, expensive, floating-point 
computer systems. However, the number of applications that could 
effectively vise small-scale hardware control systems that work in real 
time has greatly increased, especially with the advent of the 
inexpensive microprocessor. 

While the recent advances in digital hardware capabilities have 
opened many new possibilities for control system implementations, 
they have also raised new issues. A number of these involve the pro- 
blems that arise in dealing with the fixed-point arithmetic and 
finite wordlengths (limited storage) of small-scale digital systems. 

As these problems are not addressed at all in the idealized mathematical 
design procedures that have been developed to date, a methodology must 
be established for treating the digital implementation of a design. 

The mathematical design procedure , only a first step , produces an 
infinite-precision compensator that is 'ideal,' at least with respect 
to all finite-precision implementations. The job of the implementation 
step will be to specify and order the critical computations that roust 
take place in the compensator so that the end result (finite-precision) 


performs as close to the 'ideal' as is consistent with the expense and 
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and speed requirements of the application. The implementation step 
will also include a specification of the hardware architecture and 
components. It is important to note that the mathematical design and 
the implementation phases are not totally independent , since the im- 
plementation can be very important in determining an acceptable sam- 
pling rate and the number of operations that can be performed per 
sampling period. 

Some effort has been directed to the implementation phase of an 
overall controller design, but it has been quite limited. Knowles 
and Edwards [4] have considered some roundoff noise questions for a spe- 
cific classical controller design. Sripad [5] has looked at the roundoff 

noise and coefficient sensitivity of the Kalman filter. Rink and 
Chong [6] have derived bounds on the quantization error in floating 
point regulators. 

Our approach will draw on the field of digital signal processing 
[7] , which has generated many results concerning the realistic imple- 
mentation of digital filters. The finite precision effects of coef- 
ficient quantization, limit cycles, and quantization noise have been 
reviewed (for filters) in [8] , [9] , and [10] . These results are very 
important for control applications, since a control system can be 
viewed as a digital filter (compensator) imbedded in a feedback loop 
through a plant. Our work is a first step towards bridging the gap 
between the digital filtering results (no external feedback) and the ideal 
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controller design procedures. This paper bring the techniques for 
digital filter implementation to bear on the fixed-point compensator 
coefficient wordlength issue. 

Approximating the coefficients of an implementation with a finite 
number of bits will cause a degradation in the system's performance as 
compared to the ideal. Assuming that a given quantitative performance 
measure is provided, we can measure the tradeoff in the number of bits 
vs. the degradation. Then, assuming that we specify an acceptable 
amount of degradation, one must determine the minimum number of coef- 
ficient bits needed to meet this goal. Clearly a straightforward way 
to determine this wordlength is to simply reevaluate the measure of 
performance over a number of different rounded wordlengths , and to 
choose the smallest wordlength meeting the design specification. 

This brute force method cam be quite time-consuming. The concept of 
a (simpler) statistical estimate of the wordlength originated in the 
study of digital filters with the work of Knowles and Olcayto [11] . 
Avenhaus [12] applied this idea to the digital filter power transfer 
function (as a performamce measure), and later Crochiere [13,14] used 
the concept with the filter trams fer function magnitude amd a word- 
length optimization procedure. All three of these studies chose dif- 
dif ferent performamce measures , none of which seem to be particularly 
appropriate for control problems where the compensator phase is critical. 
In this paper we wilj. adapt the statistical wordlength concept to the 
steady-state linear-quadratic- Gaussian (LQG) control problem, using the 
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LQG penalty function as our measure of performance. After discussing 
the LQG configuration, a notation for specifying different implementa- 
tions will be presented, followed by the actual statistical wordlength 
procedure. Examples demonstrating this procedure and comparing it to 
the brute-force method follow. 

2. The LQG Controller Problem 

This section will present the single-input single-output LQG 
control configuration and the mathematical (ideal) design of the 
compensator. The discretized plant equations are described as follows 
(assume a given sample rate) : 

x(k+l) * $x(k) + Tu(k) + w^(k) (1) 

y (k) - Lx(k) + w 2 (k) 

where $(nxn) is the transition matrix, T(nxl) and L(lxn) are the 
input and output gains, and w^ and w 2 are discrete white Gaussian 
noise sequences with covariance matrices 0^(nxn) and (lxl) respect- 
ively. The control law is chosen to minimize the following performance 
index: (the discretized version of a continuous-time performance 

index) 

J ® E | lim l (x'(k)Qx(k) + x' (k)Mu(k) + Ru 2 (k))j (2) 

( i-*» 1 k=»-i ) 

where Q is nxn, M is nxl, and R is lxl. The result is the following 

t 

regulator/Kalman filter compensator: 


( 3 ) 


u(k) «-Gx(k) 

Note that the equations in (3) base the current control u(k) 
only on past outputs y(k-l), y(k-2) , ...,[1], A real compensator 
(one that can be implemented) cannot allow u(k) to depend on y(k), 
since a finite amount of computation time must elapse before y (k) 
can affect the output u. Thus y(k) can affect u(k+l) but not u(k). 

The gains G(lxn) and K(nxl) can be found by solving the fol- 
lowing two algebraic Ricatti equations [1] : 

p« (^^R" ;L M , ) , p{I-^(R+^ , p^)" 1 ^ , p}($-^R" 1 M , ) + a-iafV 

-i (4) 

Z » ${l - EL’ (0 2 +LEL r ) L}Z$* + 0^^ 

and 

g - (R+^ , p^)“ 1 ^ r p($-^R■ 1 M , ) + r^m* <5) 

K = $ZL'(0 2 +LZL')" 1 

Figure 1 presents a simple block diagram of the system and its 
(infinite-precision) compensator. This ideal compensator (3) can 
be described by an infinite-precision map (transfer function) in the 
digital frequency domain: 
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U(z) 

Y(z) 


-G(Z 


- <£+KL + ro 



( 6 ) 


The digital filter transfer function (6) oust be Implemented 
in finite precision with as little degradation in some system per- 
formance measure aa possible, m the setting of a steady-state LQG 
problem, it is convenient to select the performance index J in (2) as 
the measure of performance, since it reflects the weighted steady- 
state SMS state and control fluctuations. It would also have been 
possible to choose a criterion such as phase margin, output noise 
power, or any combination of stability or noise measures. If the 
problem under consideration was simply a Kalman filter, tben a 
suitable performance measure would be the trace of the error covariance 
matrix. We have chosen J in order to present our results in a 
specific context. These results extend in a simple and direct fashion 
to other measures . It should also be noted that the selection of a 
single- input single-output system has only been done for convenience, 
and the following analysis can be easily extended to the multiple- 
input multiple-output case. 
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3. Algorithms and Structures 

In order to discuss different implementations, one must have 
an accurate notation that reflects these differences. The term 
•algorithm* or •structure* will be employed to specify the exact finite- 
precision procedure by which the compensator output samples u are 
generated from its input samples y. All structures for implementing 
a given filter or compensator would perform identically under infinite- 
precision arithmetic, but will produce different quantization noise, 
coefficient quantization effects, and limit cycles given the 
(realistic) finite-precision environment. A good review of seme of 
the structures used to implement digital filters can be found in 
(14], [15], and (16]. 

In order to demonstrate the finite _ precision effects of different 
structures, consider the following example. Assume that an ideal 
compensator has been designed, and that its (infinite-precision) trans- 
fer function is given in (7) . 


0(z) 

Y(z) 


-1 

z 


!+l.llz“ 1 +0.287z" 2 


(7) 


One possible structure for implementing this filter is the direct 
form II [7] . Figure 2-A shows a signal flow graph of this filter 
where the coefficients b^ and b 2 can be read directly from (7), the 
unfactored ideal transfer function. Given finite precision fixed- 
point arithmetic (say 10 bits total per coefficient) , the ideal 
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coefficients values of b. and b_ must b« quantized (assume rounding). 

JL 6 

Reserving two bits for the integral portion of the coefficient word 
(bits to the left of the binary point) and 8 bits for the fractional 
portion, the rounded coefficient values would be 1.109375 and 0.28515625. 

Figure 2-B shows the flow graph of another common structure, 
the cascade form. Here we realize (7) by a series cascade of two 
first-order filter sections. The coefficients a^ and can be found 
by factoring the denominator of (7). Again, the ideal values must be 
rounded to fit 10 bit words, producing a^“C .69921875 and 
a 2 -0. 41015625. 

Now let us examine the performance of these two structures given 
their respective finite-precision coefficients. The (10-bit) direct 
form II and the cascade have the transfer functions shown in (8) 
and (9 ) respectively , 

7TT- r? <”> 

YU ' 1+1.109375Z + 0.28515625Z 


U(z) 

Y(z) 


-1 

z 

1+1 . 109375Z** 1 + 0.2867889404296875 


(9) 


Clearly these two structures produce slightly different transfer 
functions under finite precision, and we have not even mentioned 
their respective quantization noise and limit cycle behavior. Thus 
different structures will in general result in different finite- 
precision performance even tnough their infinite-precision 
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counterparts have equivalent performance (that of the ideal design) 

In order to deal with these different structures, it is important 
to have an accurate way in which to represent the operations involved, 
lhe modified state-space of Chan [15] is thi* most convenient method. 
Consider a filter (compensator) with input y , output u, and state vector 
v. Then the coefficients and the sequence of multiplies and critical 
additions in any structure can be specified with the following 
representation : 


v(k+l)"j 

v(k) 


y (k) 


Two important points make (10) useful: 


(1) Each (rounded) coefficient in the structure occurs once 
and only once as an entry in one of the ip ^ matrices . The remainder 
of the matrix entries are ones and zeros . 

(2) The concept of a precedence to the operations (multiplies, 

adds, and quantizations) is maintained. The ordering ^pf the <p 

matrices implies that the operations in computing 'P , 1 „ , I are 

v(k) 


completed first, then p 




y (k) 


r v(kf 

1 y(k) 


next, and so forth. The 


parameter q specifies the number of such precedence levels . 

Consider the example of the last section. The direct form II 
in Figure 2-A has a ona-level modifed state space representation as 
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shown In (11) , while the cascade (12) requires two levels to describe 
its operations (even though its multiplies can be confined to one 
level): 



( 11 ) 


v(k+l) 

_u(k) 



( 12 ) 


Thus any two structures will have associated with them two 

different sets of ip matrices. Let the coefficients in each \p. matrix 

be replaced by their infinite-precision counterparts (their values 

before rounding) , '*nd define 'p^ to be the infinite-precision product 

’p 'p , ' p, . This matrix \p will then be identical (within a 

q q-l 1 00 

similarity transform) for all structures - it depends strictly on the 
idea] design and choice of states v(k). It is also notationaliy 
convenient to partition if/ into a state-space representation, with no 
feedthrough term, (see Section 2.) 


i 



(13) 


v(k+l) 

u(k) 


*u 

L*21 0 



"vCkf 


y(k)_ 


Thus (13) represents the ideal compensator' s input-output behavior 
in a state-space form, and any factorization (10) of with the 
resulting coefficients rounded, will represent a specific finite 
precision structure for implementing the ideal transfer function. 


4. Statistical Wordlength 

The need for a coefficient wordlength estimate is twofold. 

First, the computation of an estimate should be simpler than directly 
evaluating the performance measure over and over as ’the number of 
coefficient bits is varied. More importantly, if the estimate is 
continuous in nature (not confined to integral numbers of bits) 
then it is possible to apply simple optimization techniques to syn- 
thesize better structures. The statistical wordlength estimate can 
fulfill both these aims. 

The remainder of this section will review the basic development 

of the statistical wordlength measure. [13] Consider a general 

measure of performance f. With a finite-precision implementation, the 

resulting f will then depend on the coefficients (c, ,c_,...,c ) of the 

12m 

structure. The value of f associated with any particular finite- 
precision structure will reflect a degradation in performance as 
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campared to the ideal (unrounded coefficients) case f . This 

00 

degradation df can be expanded in a Taylor's series about the ideal 
value. To first order 


d£(C l' e 2 V" (I, dc i) 

i“l \ 1 m / 


(14) 


, th 


where c. is the i coefficient to be rounded, dc. is the error 
1 l i 


3f 

to quantization , and -r- 

dc , 
1 


due 


is the first partial derivative of f 


evaluated with the unrounded coefficient values. Note that coef- 
ficients such as 3,2,1, j .... are not normally affected by rounding 
and s .■ xld not be included in the sum (14) . 

If A is the quantization step size (the fraction represented by 
the least significant bit of the fixed-point coefficient word) , then each 
dc^ must lie between +_ -j (rounding assumed) . Given the partial derivatives 
in (14), we could then (upper) bound the error df, producing a very 
pessimistic word length estimate. 

The basic statistical wordlength idea is to treat an ensemble 
of structures. Over this ensemble, the coefficient errors dc^ cam 

be described as uniformly- distributed zero- mean uncorrelated random 

2 

variables, each of variance A /12. The error df is therefore also 
zero-mean, with a variance: 


Aim auuMi 
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For large m, the central limit theorem can be applied to 

justify a Gaussian distribution for df. Thus with a given confidence 

2 

level (probability) , say 95%, one can predict the variance CT 

df 

needed for the error df to remain within some prescribed bound. 

In other words , 95 out of 100 of the structures in the ensemble will 
result in systems where df remains within this bound. 

From a table of the Gaussian distribution, 


Pr(|df |< 20 ] - .954 

If the. quantity of interest f is constrained to lie within +_ E c 

of the ideal f then (16) implies that a_, equal E /2. This 
00 , df o 

result can be combined with (15) to produce an estimate of the 


l Hr I 

i*l \ i 00 


Given A, the statistical wordlength can be defined to be 


SWL = SL + log. 
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•Rie first term in (18) represents the number of bit necessary 
to represent the integer portion of the coefficients (bits to the 
left of the fixed-point binary word 'decimal point') and the second 
term gives the number of bits necessary for the fractional portion 
of the coefficient word (bits to the right of the binary point) . 

In the digital filter area, Crochiere [13,14,16] presents a 
number of results comparing the statistical wordlength of structures 
using the transfer function magnitude as the performance measure f. 

Since this choice of f is frequency-dependent, the resulting estimate 
is also frequency-dependent. The final wordlength can be selected 
as the maximum of the estimates over the frequency range of interest. 

In the examples treated by Crochiere, the statistical wordlength 
estimate was always 1 to 3 bits conservative as compared to the actual 
minimum number c " bits necessary to just meet the transfer function error 
limit. In a related work by Chan and Rabiner [17] , which considered a 
large number of finite-impulse-response filters and a similar statistical 
approach to coefficient wordlength, the resulting 95% confidence level 
estimates were also observed to be conservative. Crochiere [13] was 
also able to use statistical wordlength as the basis for an optimi- 
zation procedure involving the filter-specification filter-order 


tradeoff . 



5. Statistical Wordlength and the Performance Index J 


As mentioned above , it is convenient to use the performance index 
J in (2) as the measure of performance f in an LQG setting. 

Using the approach of the previous section, the change in J would be 
estimated by: 


dJ (c. ,c , • . . , c ) 
12 m 



(19) 


However, the optimal nature of the LQG control problem forces all 
3J 


the sensitivities 


3c, 


to be zero. Therefore a higher-order 


approximation is necessary: 


m 

dJ » l 
i=l 



dc . dc . I 

1 V 


(20) 


The use of second-order terms (not seen in digital filter analysis) 
will make the statistical wordlength expression for LQG compensators 
unique , and as will be shown , quite complex to compute . 

Proceeding from (20) , the mean of dJ will no longer be zero: 


m 3 2 t 

E(dJ) = l - — : 

i=l 3c/ 
i 


E[(dcJ ] 


( 21 ) 


For convenience, define the random variable € to be the square of 

2 4 

dc^. Its mean and variance can be shown to be A /12 and A /180. 
The second moment and variance of dJ can now be found: 
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EKdjl 2 ] - e 2 



+ 2 (€) 2 l 

i=l 



00 


( 22 ) 



e 


m 

I 

i=l 


a 2 j 

3c. 2 

x 


+ 4 (€) 2 


I 

i=l 

i>j 



(23) 


The same Gaussian assumption and confidence level approach can 
be applied to this higher-order formul&tion, as shown in Figure 3. 
Since the value of J can only increase under coefficient quantization, 
we need only have a specification on its maximum allowed value 
J + E . If we choose two standard deviations around the mean, then 

oo o 

we can write 

J, + E = J + dJ + 2a (24) 

oo o 00 dJ 

This choice of a._ gives a 97.5% confidence level in terms of 
aj 

remaining below the allowed deviation E . Combining (22) , (23) , 

o 

2 

and (24) we can derive an expression for A : 




- 20 - 



(25) 


Using (18) , the SWL can then be written: 


SWL = H + ~ log i 

2 ’2 A 


(26) 


The use of second-partial derivatives in approximating 
dJ in (20) has given rise to a complex expression for the 
statistical wordlength. Efficient methods for evaluating (26) 
will be discussed in the* next section. 


6 . Computational Procedure 

In order to compute the derivatives of the infinite- 
precision (ideal) performance index , it is convenient to use the 
trace form of equation (2) : [18] 

J = trace [S Z] (27) 

00 

The 2nx2n matrices S and Z are defined by (28) and (29): 

Q miJj 

s = 

\p' M' ip' Rip 

L 21 Y 21 y 21 


(28) 
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Z 


E 


x(k) 
v (JO 


[x'(k) v' (k) ] 


(29) 


where Q,M, and R are the performance index parameters described in 
(2) and the lower left-hand portion of ^ as described in (13). 


The matrix Z, the covariance matrix for plant and compensator states, 
can be shown to satisfy the following Lyapunov equation: 


0 . 


Z « AZA' + 


^ 12 ® 2^12 


where 



lb L 
^12 




11 


(30) 


Note that (27) -(30) depend on the infinite-precision (ideal) 

compensator and on the selection of compensator state variables v. 

The resulting will be independent of structure. However, the 
partial derivatives of J (evaluated for ideal coefficients) will 

depend on the structure since each coefficient c^ resides in one 

of the structure 1 s tp matrices . Taking the partial derivatives of 

(27) will produce: (assume all partials are evaluated at the ideal 


values of the coefficients) 
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( 31 ) 


At first glance, (31) represents a great deal of computation. 
The first term requires the solution of (30) for Z. However, the 
second trace term involves the first partial derivatives of Z: 


3Z . 32 - 

-s- ■ A -r — A' + Q. 
3c. 3c. l 


(32) 


where 


~ 3A 3a 

Q. * - — ZA' + AZ - — + 


*i 3c. 


3c. 

i 


Vu + *12 0 2 y 

'1 1 t 


Evaluation of the second trace term in (31) for all i or j will 
imply solving m Lyapunov equations of the form shown in (32). The 
final term of (31) requires second partials of Z: 


3 2 Z 


3c. 3 
i c 


3 2 z 

3c~5c . A ' + C ij 


(33) 


where the 2nx2n matrix involves partial derivatives of A, 3, and 
with respect to the i^ 1 and coefficients. Solving (33) for all 
i and j would require m(m+l)/2 more Lyapunov solutions. 
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Fortunately, this burden can be substantially reduced. 
Specifically, the concept of adjoint operators can be used [1] to 
simplify the last term of (31) . If we take the trace of the product 
of two matrices to be an inner product on the space of matrices, and 
L to be a matrix operator, then: 

trace(L(X) U) - trace(X L (U) ) (34) 

* , 
where L is the adjoint operator of i. For !(X) * X-AXA , the 

* 

operator L can be derived from (34) : 


trace ( (X-AXA' ) U) - trace (XU) - trace (AXA'U) 

« trace (XU) - trace (XA'UA) 

- trace (X(U-A'UA) ) (35) 


Thus L (u) = U-a'ua. This adjoint operator can be used to simplify 

2 * 

the last term of (31) if X is 3 2 and L (U) equals S. Since 



3c. 3c . 
i 3 

we can rewrite (31) : 



3Z as 

3c + 3c . 
3 3 



+ trace (UC. , ) 
ij 


(36) 


where U satisfies U-A'UA*S. Thus the last term of (36) requires only 


one Lyapunov solution. 
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There is still the problem of the m Lyapunov solutions needed in 
term 2. By using the Lyapunov solution method of Barraud [19], this 
computation cam also be simplified. Consider the general Lyapunov 
equation (37) s 


FXF ' + C 


(37) 


Barraud' s method breaks into two distinct parts, one which transforms 
F into the upper Schur form, and one which back substitutes using the 
transformed F matrix and C. The major portion of this computation 
involves the initial F transformation. Thus, if there exists several 
Lyapunov equations with identical F matrices but different C matrices, 
then the F transformation need be done only once. This is exactly the 
situation for the Lyapunov equations (30) and (32) needed for the 
first two terms of (31). Typically, 50-90% of the Lyapunov computation 
time can be saved, depending on the particular matrices. 

Further computational time savings are possible. Certain partial 

- as 

derivatives involved in the Q , C , and -r- expressions are known to 

i ij dc. _ 


be zero and need not be computed. As an example, the term 
must b« zero if the i*^ and j^ coefficients are in the same 


3c . 3c . 
i 3 


precedence level. Suppose ^ equals (three precedence levels 

exist) . The nature of the modified state-space representation 
guarantees that each of these coefficients may be a single entry in 
only one precedence level. Assume that c^ and c are both in 
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Taking the partial derivative with respect to c^s 




3c, 


\ 


( 38 ) 


The matrix 


3^7 


must be an all-zero matrix excluding a single unit 


entry at the same location as c^ in The expression in (38) is 

now independen t of c , implying that ^ — equals zero. 

The specific details of the computational procedure (heavily 
involving the use of trace identities to simplify expressions) and 
the program itself can be found in the appendices of [20] . 


7. An LQG Example 

The following sixth-order example was chosen to test the 
statistical wordlength algorithm. It is adapted from the longitudinal 
control system design done for the F8 digital fly-by-wire flighter 
[ 2 1 J . 


Continuous Time System Parameters 

: 





-0.6696 5.7xl0‘ 4 

-9.01 

0 

-15.77 

« 

0 


0 -0.01357 

-14.11 

-32.2 

-0.433 

0 


1 -1.2xl0 -4 

-1.214 

0 

-0.1394 

0 

A - 

1 0 

0 

0 

0 

0 


0 0 

0 

0 

-12 

12 


0 0 

0 

0 

0 

0 
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B - [0 0 0 0 0 1] 

C - [1 0.003091 31.28 1 3.592 0] 


Continuous- Time Performance Index Parameter; 


Q 


6.637 

0 

0 

0 

0 

0 

0 

2.6554X10 -7 

2.686xl0” 3 

0 

3.085X10 -4 

0 

0 

2 .686x10** 3 

27.174 

0 

3.121 

0 

0 

0 

0 

27.174 

0 

0 

0 

3.085xl0" 4 

3.121 

0 

0.3585 

0 

u 

0 

0 

0 

J 

0 


R « 5.252 


Continuous-Time Noise Covariances 


* diag[0 0 0 0 lo' 6 io” 6 ] 


0.00360825 


This continuous -time system was discretized at a sample rate of 
10 HZ and the optimal regulator and Kalman filter designed. The 
double-precision parameters $>, F, L, Q, M, R, 9^, © 2 , G, and K can 


be found in f 20 ] . 
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Four structures for implementing the ideal compensator transfer 
function (6) were examined. The first three are regular filter 
structures - the direct form II, the cascade form, and the parallel 
form. The coef fi<- \ents of the direct form II structure (recall 
Figure 2) come directly from the unfactored transfer function (39) ; 
the 12 coefficients and one precedence level sure shown in (40). 


H(z) 




-1 -2 -3 -4 

a z +a z +a z +a z 
1 * a 2 3 4 


, w -1 w -2 -3 

l+b,z +b_z +bz +b.z 
12 3 4 


0 10 0 0 


0 0 10 0 


0 0 0 1 0 


-5 -6 

+a_z +a-Z 
5 6 


4 -5 

+b,z +b z 
5 6 

0 0 

0 0 

0 0 



(39) 


(40) 


The actual a. and b. values, and the ideal coefficient values for 
x x 

the other 3 structures can be found in [20] . 

The second structure, the cascade (see Figure 2) , derives its 
coefficients from a multiplicative factorization of (39) and breaks 
into 3 series direct form II second-order sections. The factored 
transfer function (twelve coefficients) and the two precedence level 
matrices and $ are shown in (41) and (42)s 
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(r,z" 1 +r*x 2 ) U+r_z 1 +rz 2 ) (l+r_z 2 +rz 2 ) 

HU) - -i .2" r r -2 - -1 '-— 2 (41) 

(1+C^Z +C 2 * ) (l+CjZ +CjZ ) (1+CgZ +c g z ) 


1 

0 



0 

0 

0 

0 


0 0 0 
10 0 
0 10 
0 0 1 
0 0 0 
0 0 1 
0 0 1 


0 0 0 

0 0 0 

0 0 0 

0 0 0 

10 0 

0 10 

Oil 


(42) 



0 

1 

0 

0 

0 

0 


’ L 0 0 0 


0 r s r 5 ° 


The third structure, the parallel form, corresponds to a partial- 
fraction expansion of (39) and breaks into parallel direct form II first 
and second-order sections. The expanded transfer function (also 12 
coefficient^ and the one precedence level iJj are shown in (43) and (44): 


H(Z) - 


-1 -2 -1 -1 -1 -1 

e,z +e_z e z e.z e_z ez 

i-. 1 + -i— - - + -1— — + -L— . . 6 . . 

l+c,z 1 +c_z l+d,z 1+d z l+d_z 1+d-Z 

1 2 3 4 5 o 


C43) 
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Hi® fourth structure (herein referred to as the 'simple* form) 
is taken ‘directly from the original LQG compensator equations (3) . 
The parameters of $, T , K, L and G are taken to be the coefficients 
of this structure. The form of the transfer function containing 
these coefficients is shown in (45) , and the modified state-space 
representation of the structure (two precedence levels ) is shown 
in (46) : 

H(z) * -G(z-<J+KL+rG) -1 K (45) 


t 
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* 2*1 


$ 

—J 

-K 

-r 

-000000 

0 

-l . 



(46) 


Table 1 presents data concerning the statistical wordlength 
estimate for the four structures described above. For this system, 
a five percent degradation was specified as the maximal deterioration 
allowable in the measure of performance J. 


SWL TWL 

Structure (eqn) S, bits (time) bits (time) coefficients 


direct- I I (40) 

3 

26 .68 (. 75) 

27(1.18) 

12 

cascade (42) 

1 

16 . 78 ( .81) 

15(1.34) 

12 

parallel (44) 

1 

12 .65 ( . 71) 

12 (.77) 

12 

simple (46) 

5 

22.50 (4.2) 

21 ( . 76) 

47 

TABLE 1: 

SWL Results 

for the F8 Example 



The effect of structure on coefficient wordlength is evident 
from Table 1. The direct form II structure requires by far the most 
bits, while the cascade and parallel forms require the least. Both of 
these results are also typical of digital filters [7] . The simple 
form structure derived directly from the LQG compensator equations 



requires an intermediate number of bits, but its most undesireable 
property is its 47 coefficients, implying many hardware multipliers 
or a long calculation time (low system sample rate) . 

As an estimate, the statistical wordlength for this LQG example 
is between -.32 and +1.78 bits of the true wordlength (TWL). With 
this error range, the statistical wordlength estimate is quite useful 
both for the comparison of different structures and for the deter- 
mination of an acceptable design wordlength. For comparison, the 
digital filter examined by Crochiere [14] hats statistical wordlength 
estimates (based on transfer function magnitude) that were between 
1 and 3 bits conservative. 

Before interpreting the computation times listed in parentheses 
in Table 1, the method for determining the true wordlength must be 
described. The performance index J is roughly a monotonic function in 
the number of coefficient bits. This fact allows a binary search type 
of algorithm to be used, re-evaluating the index J until the degradation 
specification is met with a minimum number of bits. Unfortunately, 
there are several problems that can arise. First, when rounded coef- 
ficients produce an unstable closed- loop system, J can be below its 
value and even be negative. Even when this situation does not occur, 

J is not necessarily montonic; certain values of J can be slightly 
smaller then the J value using 1 more coefficient bit. These two pro- 
blems can slow down Cor 'tie up') the search algorithm used in 
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determining a true required wordlength , and explains the 1.18 and 
1.34 second computation times for the direct and cascade structures' 
true wordlength . 

Comparing the computation times for the statistical and true 
wordlengths, we see that the statistical wordlength is somewhat 
faster to compute in all cases except the simple form. This excep- 
tion is due to the strong computational dependence of the statistical 
estimate on the number of coefficients. However , as mentioned above, 
this simple form would probably never be considered due to the 
hardware implications of computing 47 multiplies per sample period. 

8. Conclusion 

This paper constitutes a first step in examining the issues 
involved in the digital implementation of control compensators. To 
deal with these issues , we have sought to ally the fields of digital 
signal processing and control and estimation, a fairly novel approach. 

More specifically, this paper treats the statistical coefficient 
wordlength issue for the LQG compensator using fixed-point arithmetic. 
After reviewing the LQG design procedure and defining the notion of 
an implementation structure , the statistical wordlength concept for 
digital filters was described. In adapting this concept to a control 
and estimation problem, we stressed the importance of selecting a 
good performance measure. The index J was chosen for the LQG problem, 
although the method readily extends to other measures (for example. 
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the covariance matrix trace for Kalman filter problems) . Finally 
2 m efficient computational method was discussed and an illustrative 
example presented. 

Our results demonstrate the feasibility of using the statistical 
approach in determining a sufficient LQG compensator coefficient 
wordlength. One application of this technique would be in the com- 
parison of different structures for implementing a design. In 
addition, the statistical wordlength is also an accurate criterion 
for selecting the wordlength once a specific structure is chosen. 

Perhaps of more importance , the continuous ’closed-form' nature 
of the statistical wordlength estimate makes it possible to synthesize 
minimum coefficient wordlength structures in a straightforward manner. 
Chan [15] has described such a technique, using the modified state- 
space notation, for digital filters. This idea can be easily extended 
to the LQG statistical wordlength estimate presented in this paper. f20] 

Finally, as a qer.aral technique, the statistical measure of coef- 
ficient wordlength can be applied to a variety of control and estimation 
problems, using whatever measure of performance seems appropriate 
(gain margin, phase margin, transfer function magnitude and phase, a 
covariance matrix trace, etc.). Within the computational formulation 
of sections 4 and 5 , s uboptimal LQG compensators or Kalman filters can 
be considered simply by including first derivative terms in the analysis 
(with a moderate increase in computation) . These and related questions 
are considered in more detail in [20]. 


i 
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